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^ This in. the Final Report for/orttract NQO014>75^C^op8 coven nci p^^^ 
if- three and three-quarter /iars -from January 1975 to Septeniber lp7d. 
/Research was performed " i n .two *jof areas:, instructional theory. ^nd _ 
devplspmejit Of a generUized mintenancfr tfainer-simu atbr. • The ;domcnn . 
of instructional theory incl udeii. f ive reTated research projects,, These^ 
were the effects of visua) arialogies of abstract concepts, Markov decision 
' models for instructional sequente'optimizatidn, electrophysiological 
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correlates of cognitive proces.sing. cognitive stnategies for text , 
processing, and. heuristic techniques for. logical problem solution , The 
w6rk oh the developnient of the malntfenatice tr'ainer-slrnulator included 
tests- of the s^.stem in iiav*y School environments and led' to a project to 
fi^jrther 'develop the system for regular use in N^yy schools. 

" ■■' ■ In flddi tVon- to producing instructionnT systems Vhich. a re. now 
being .developed for*' use i n -Navy schools, this contrrJct produced fourtep/i . 
technical reports, seven chapters in booits ar articluj in journals, and 
ninefpapers for professional meetings. ■ , 
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to, Septeffnbfer 1978. . Research was perforfiied In tv/o major areas:^ Instruc- 
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In addi tion to produrt^j^Jnstructional systems which are now 
being developed for use in Navy schoojs , this .contract produced .fdiirteen 
tachjilcal reports, seven chapters in books or. articles in jdurnals, and 
nine pap^ers. for professional meeti^ngsv , 
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' RESEARCH ON LEARNING STRATEGIES AND .. • 
HANDS-ON TRAIN.ING IN CAI . , 

• , ■ ' . • I . IN\TRODUdT.I0N ' ' ' . ^ . 

, This report cove rrS' a ^eHoj of three and three-quart'Sr years', 
from 1 Januar}> 1 975 to ^0 September 1978. . The work performed during this 
interval M^^ag, qoncerned" with two niajdr research areas: instructional /t^enry 
arid '^evelopfTiInt of a mai ntenance strainer-simulator. The projects related 
to instructi'Qnal theorj^ were' visual anal^tes of abstract CQncepts* ^ 
Markov decision rnodels for Instructional sequence optimization, electro- ^ 
physlologlca^l correlates of cognitive processing i cognitive strategies 
for text processing, and heuri^ticHechnlques for logical problem solu- 
tion. The research on the.se instructional theory tODtcs was primarily 
conducted' in laboratory .envirgnmertts. ^ The research on maintenance 
trainer-slrriulators Included testing of the research products in Navy 
'school environments. ' ' 

During this period, 14 'technical Reports, s^en chapters ^in books 
and publications in professi^onal journals, and nine papiers ■for profes- 
sional meetings vmr$ produced/ The inaintenance trainer-si mulator developed 
and tested under^ this .contract is currently being adapted' for "use in Navy 
Clas/^ schobls , ijnder a contract, sponsored by the Navy Personnel Research* 
and Development ■Center and the Defense Advanced , Research Projects Agency., 
further^ appi i ca tions for the trainer are' being i nve5tigate"d,; 

BTL research on ins true tional theory during the almost four-year ^ 



period of^the contract refle^tts an increasing awarenes;s of. advances in 
cogtiitive proce.ssing theory. This ^research represents , an .attempt to ' j 
'apply these advances tb 'instructional contexts. Cognitive models and\ 



exper1nie,ntal results guided, thfr-eyol ut1or) of our resiarph 1n this area. 
With the exception of the work.-on Markov models for instructional optimiza- 
tion, all five of the. projects carried out on instructional theory w<|re 
influenced by cognitive psychology fnodels. In partlGu]ar, the' recf n.t . 
work on s^tegies for text processing was guided by a cognitive processlrlg 
model, developed in a schema .theory framework, of the readin-g prop&sS'. ; , 
BTL research has also been influenced by, advances in instrt/etianal- 
delivfery technology. Moving with the rapidly evolving computer Indus trj*,-. 
more powerful yet smaller computer systenis have been employed. In some 
cases, BTL staff designed and built hardware configurations for corfipnter- 
based instruction that are. only how bting offered off-the-shelf by com- ° 
puter companies or peripheral manufacturers, (Fo^^exaraple, a computer , " 
Interface to control a microfiche projector was developed in ouir labo- 
ratory bfef ore any were made available commercially.) Although some of 
the research done under this contract made use of a large time-share' ^ 
computer system specifically designed for CAI (the PLATO IV system,), 

* there has been a trend for our research to move away from the usa of 
such large systems tovvard' single- user d1 sk-based. microcomputer .systems , 

.Future BTL efforts are likely to continue to exploit the low-cost, reli- 
ability, and availability features Of s^Ch micro systems. ■ In additiorn 
much of our future work will exnloit tha new software transDortabll 1 ty 
features of, the UCSD Pasffil opera ti ng sy&tem. , ' , .. . 

• In the remainirtg sections of 'this report, progress .in each of six 
.major research areas/s reported. The f^rst five topics can be grouped 
under the general^h^ading of Inst rue tioWTTReory'and^^^ 
topic deals with /he development and testing of .the Rigney trainer- «• :^ 

. simulator. , ' , Y ' 



^^11. VISUAL lANALO^lis OF ABSTRACT CONCEPTS' • / ' . \: 

Jhree technlcaT reports .•and a publlsh^^.paper the -Journal of 
Educational Psychology JRIgney & Utz, 1976) jde^cribed work on the effects 
of visual analogies from 1975 to 1978, The work was ^moti vated, In parti 
by^a desire to explore %hm effects of right-hertn sphere ^ imaglnal pro- 
tessi ng on retention^ of reUtiv|l7* abstr Mental imagery, it" 

was f^elt, could be expected to provide a duaT-coding of the abstract 

■ * ■ ■■ ' ' y ' ■ ■ . . ■ ■ . 

concepts, to be • liar nedV^Aen .conjoin traditional verbal exposi- 

■ tion of ^!he concepts, the ^^Kistence^ of luch' a dual code in the m1nd of 

a student was expected/t«' improve the probabnity of recall of the concep- 

tual material. * , ^ 

.The experfments to test thise hypothases made use of special 

instructional materials' #v*#l oped ^a^t Behaviqral Technology Laboratories, 

dealinVwith electrochemi$tr^/ fmagi.nal and non-fmaginal techniques were 

cdtipared, in two qontexts : Hnitiai accj'uisl tion of conceots and rehearsal 

of coqcepts for recVn , ■ S«yer,al study techniques and concept presentation 

modes were studied. Including experifflenter-suppl led Interactive graphics, 

additional written explanation >of concepts, student-generated illustra- 

tions', student paraphrases, 'and mental ly generated verbal analogies The 

results' of the series of Studies show that,, in the case of initial acqui- 

Sition.'of the abstract concept, used , experimenter-supplied Interactive 

graphics resulted, In significantly better recalls. For" post-acqui sition ■ 



practice with the doncepts the most effective means' of improving recall's 
was. a method. in which s'tudents were.-gurideC to reconstruct •a'gra'phic; 
illustration of the concepts.. The results of theffi experiments suggest . 
guidelines for the use of graphics features in CAL/ ^ i-.- - 
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Joseph n\qmy &'Kathy A; Utai, The effects of interactl.ve graphic 
ar»4logi1es of concocts In, chemistry « Mayvl975. , 



- ■ Recent advances in knowledge about, the different information 
processing functions of the right and the left cerebral hemispheres, 
and laboratory studies of thew different functions were- reviewed for 
their Impllcaitlons for traininf and education. The evidence is, that ' :, 
the right h«m1 sphere is special Ized for spatial and topographic imagery 
processes, vihile the'left is ipacialized for StriaT , analytical, Ian-' 
guage processes. The two Kemi spheres have d1 fferenf d'egrees of access 
to the vQcall zing system on the midline, whith is, primarily under the 
control of the left hemisphere, and' to the motor .systems for the right 
and left hands, Under certain condltlohs, the left hemisphere can • 
override control over these systems' by the right. The task that is ■ 
given to tHe subject,' the orienting task, not only determines the ■ 
subsequent 'Information processing done to mediate responding, but also • 
influencos v<hare this processing is doDe in the, cerebral hemispheres. 
Recent studies of the effects' of mental imagery on Teaming a.nd memory 
predominantly find strong positive effects. In yerbaT learning whatever 
mental imagsry adds, a spatial organization, an ■ integratl ng context,! or 
a second coding, it is clear that it results in better retention and 
recall In the laboratory, " , ; ^ 

The 1mpl icatlbns of this for training and education are that ^ 
the frght^h^rntsphere^functions hbve been relatively neglected Jn the 
predQtninantly verbal mediation of Mnstructlon and knowledge. The 
'challenge, to instructional teqhhoTogy is "to '^tilize■the dual-coding, 
system mor^ effectively. . ^ ■ \ ; 

: ■ The first of several planned studies, using interactive, animated 
^graphics fpr .11 1 ustrati ng the abstractions, concepts and laws of science, 
and for sttmuliatino imaglnal prQcesses in studentsf is described in thi-s 
report, it was found that thasa graphics did have positive effects on 
the learning of concepts in electro-chemi stryj^as measured by recall 
tests Xif knowledge, comprehension, 'and\ appl icatibn; and tHat the lesson 
conttlning tfne-se .graphics was more- attractive .to- students than a lesson 
in which purely verbal explanation was used. Subject^ who took the 
lesson* providing external imagery reported experiencing ^^mor'e internal 
imagery than did the subjects who' recei veti the verbal, version. 

TheSfe positive outcomes encourage further- research into (1). better 
methods 'foV inducing mentaV imagery 1n students: than ■verbal instructions. 
(2) theQretterl-foundatTon&-for tha^ process-irvg'.of :exterhal . imagery relatT ng 
it to current theories of the structure of long: term memory , andM 3) , 
.objective indicators of mental imaging that would more reliable than ,^ 
verbal rfep^rti of subjects. ' r'- ' , / ^ : - ■ , ' / ' 




Joseph W. Rign^y ' & Kathy" A, ,Lutz , The' effects of interactive gfaohic 
ana]agi05 of cohcepti in science, Augustl976. , . ^ 

■ t y J ■ ^ • , . ■ " ■ ^ " i s 

! . ■ . ■ ■ k • ' - - ^ ' ' ^ ■ 

' : ' 'In thU serfes ^of three studies, interactive graphics, , using 
the pla.sma paneh-touch panel Interface of the PLATO system, were used 
to simulate the ! topograph^' and .functions^ a battery, to teach ele- 
mentary ^concepts^l-n electrochemistry. The effects of these graphic^ 
were compared v^ftK yerbal^disc'^^jpti.ons of the topography; and functions, 
in otherwise equivalent lesions; ,and with playing checkers for the^same 
amount of ti TO ui^ed by^ post! esson/ condl'ti ons requiring subjects 'to_ 
■^reconstruct the graphic 'simulation from mempry, or to attempt to imagine 
^ne'ntal images ^Qf these graphics; The principal conclusions supported by 
the :resultg of tHese Studies are. as follows: - ■ 

^ , ■ ■ ' . ' ■ ■ fi 

K h% used here, interactive graphics, were rated by students to 
be a more interesting way to present information about 'abstract concepts 
in SQience, ancj therefore may have received more attention during acqui- 
sition than'did a purely verbal mods of presentation. ,When ^dorrected 
for the: effects of prior knowledge', mean scores- on yerbal and graphtcs, ; - 
posttests v/ers slightly, but si gnif IcaDtTy higher'- fo^r lesson- and DOSt- 
lesson conditians containiag interactive graft;htcs. Mental, imagery could 
be another source of these effects. Students 1n Experiment I did report 
that the graphics in the lesson induced mental imagery while they were 
taking the la&son. However, .the attempts of students in Experiment 1 1- 
to recall mental Images of lesson material did not increase scores on 
the -posttest , in comparison to 'the controVgroupv - 

2\ Intaracti ve^ graphics^ as used heret evidently are most 
effective during ini tiaracquisition. . Requi ring' studepts to reconstruct 
the graphic simulation after the initial lesson contrl buted 1 ess to 
verbal postte^t performahce. However, this postlesson condition did 
result in the acquisition of additional Information, reflected in higher 
scores on .a giraphics posttest 1n Experimenrt III, These results suggest 
that both, shall Qw. and deep processing, in the Craik and Lockhart ^ense, 
werf. indueedv^bj/- thi s postlesson 'Condi t1on. 

\ ' ' . ' . 

^ 3. The fact that students were able to deal with both toDO- ^ 

graphic and abstract conceptual information in either verbal or graphic 
form, suanest& either the same, deep structures in LTS; or rapid trans- 
fofmatiorof different structures i n ITS Into a common representatipn 
when necessary. .The .current vers ion of semantic network theory of Long 
Term^Meroory (Rumalhart and Ortony , 1976) , gives a pi ausible, account of 
this capabilit^^ in terms of a comfnon btfsi s for storage ^ and flrocessinq 
of both grciphl c , and verbal information. ^ . .. 

^ 4. It should be pointed out that these studies dealt with fixed 

effects variables, and that tKere are many other relationships between 
graph^ics and verbal modes of presentation that were not explored^, here . 
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In %om of theses one fnode v^ould complenent the other, so t^at bqth- 
would bereqjlred to convey the essential infOrrratiDn or to enable he 
desired' Performance. Such would be the case where intiract we graDiic s 
are usearto represent the f ronf^^panels of equipment and stu dents oo errte 
Oh'th€se Interactive qraphics in ways analogous to operating on the 
actual equipment front panels/ Or, the graphics might contain i nfo rms ^ 
tion only referred to ver^bany, a comiiion usage for ^diagrams or Dnoto^ 
graph s in \te^ts . , 
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r cases, the dynamics of processes might be so cbnpl ex ^ • > 
cription becomes too lon^and cliJiri^y. Aniiiia ted g-^ao McS 

student to attend to different parts of the anlmsti on - 
pidly comprehend th£ implications of the analogy or 
intem-al workings of a transistor come to mind as an 

it might be advantageous to depict electrons and hole?^' 
tio^n phenomena chanqlnq, and the "flow " o f c urrents in ) 
erse biased loaps all at once, sq tHat the s tud^n^ c ouy 

'events rather quickly into an overall coniprehens ^or^ or 
r mrks In this case, sirnul tineDuS a m'mati on of f^any 
would be a onique contri bution to diynanic graphics, since 
ion. is necessarily serial. This usage of an imated graphre< 

require a plasma panel capable of -v^ri tin g s^nd erasing at 
es than currently available. 
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Kb thy A. Site & Jostf^.h W. kinney, The effects of studen t-cenera ted 
' elaboration durlnM acquisition of concepts in sc ier^ce ^ 
September 197 7 
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scMfcb of studieb of e^per iinentei- anJs'uil^f't 
fur acqui si tion and retent ion o^ conc tnts 
I f ouhenii stry was usedasthe subject ina^te^ 
cOfiLiusions w€ believ^e are v^arrdn ted by the re- 
follows. The most ef ^ec ti ve strate qy fur faci I 
of eKperiiiientersuDplied, interact ive^ q rap^^^ 
rbal description, in coTiipdrison to dddi l:iD^idl 

i live effect ^ v^ou^d ^e 



andloqles iUsi supp le/iented 

verbal explanation. /Two eAplanations for these pos ^ 

fialoyies captured the students' attent-^on nio re et ■ pi 
provided an overall structure, by wh^ch incltwidLJal 
^\ r e la ted , serv ing a ^ a type of ory;ani zp f . 
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than usinq t^e sanis^ anount of lime to m through the lesson tv/ice. How- 
ever, drawing i 1 Ws tratiorv. of concepts in the lesson was the mi i eftec = 
tive^of thes>efaborfltion slrategies for students with liLlle or nup-'KM 
knowledge of the subject matter. 
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■ After acquisition coding has occurred,/ the most effective strategy 
1 nvesti'gated' i'n these studies was a postlesson review in which students 
were required to reconstryct the complete graphite illustration of the 

eiec trochernistry of a battery, by touching appropriate spots on the dis- 
play screen. This review may have forced the students to do Drocessina 
that integrated the various e'tectrochemical concepts. ■ Attgnpts*(€5 induce 
students to' review the lesson by generati,ng mental jmagery tr which they 
vlsaali^ed the flow of events in a battery was not an- effective review 
strategy, ■ ^ ' : 
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III- MR KOV DEC ISim MO'BEL-S FOR INSTRUCT rOK.AL 
SEQUENCE OPTiMIZ/iTI ON 

TtfjQ tethni caT repo rts e xteiid ed an ea rli er model (Wollmer; R, D, 
^ Marko'^ D-eci sion Model for Carnputlr-Ai decj I ns tructi on, Lo5/5ncelfs; 
OniversTty of SQuttierti Cal Ifornia, Behsviorpil Technology Laboratories , 
December, 1973, Technical Report rso, 72), produced under ONR Contract 
NOOOl 4-6?. A-O269.O025 . TKis research vwas conduoted from 'the ons-et of the 
contfact utiti 1 ^arch 19 76. The firs t pf the t\-JO reports was designed t 
evaluate the Wolliw raodtl i ii a CAI content, "7wo| experi tuents were p 
formed to te&t the effect on learning pf using the nnodel tcoptiinize 
practice s chedules . The results did npt reVeal a significant improve nient 
in amount lesrne^d when the o pti mi aation s js-cem was used. These results 
suggest , first, that nu^h^r of practice t rials my be less importaTit than 
other factors fcgr compl e^^ tasks, and,, second, tha t comp] ex tasks inay 
require very la rge nurnbef t. o f pra cti ce triaTs to ensure, si gni f leant p rac- 

ti ce ef "fee ts , . ■ 

The second tett,niw-ji repo rt , winic h *Has the last in the series, 
furt'hfc, Jcrverop^.j a„J,crtnc.i thr WuJllnier approach, A iTiathematf ca 1 t rydl 
mrd ot pait'di I, ^'l'-'-' iia.kwv i ' b 1 u f ' P T'oc i-E i US 1 ng an infiniie 

p|<jnr.i„9 hu. h .'Jb deVelopU AlLhuLKjf. ine ajiien, ™i. deve iuriEd fu 
coriipute r d ije^d i„>-i' uct ion a PpT k. oU unt., it haswiclei appMcdMlitj 



TR no. 76 

Richard D/wollrTier& Nicholas A. Bond, Evaluation of a Markov-decision 
. model for instructional sequence optinii tion , October 1975, 



WalTTr|r's Markov Decision Model for i nst rue ti onal sequepce 
optirtiizati on was Investigated in a computer-3SSi sted Instruction (CAl) 
cc^ntext^ Two special CAI programs served as .vehicles for testinq the 
niC3de1;on|p program (K^laws) taught the students to solve DC circuit 
problems 'psing"^K1 rcKhoff' s Laws; the other (TRIG) gave practice in 
fnsni pul at/1 Tig the six trigonometric ratios. The K-Laws course had ^ 
elevan stages or levels; TRIG had. five; both courses were arranged m 
a hierarchical order. The Wol lfiier\model requires that transfer would 
occur^frofTi one stage to the next irf a hiearachical learning sequence. 
■ tne^Ae ef fee ts could be estimated %o as to produce an optimal 
ai ni/ig s chedj le / To deter^.ine the pffects of additionaT practice, ^ 
If cal ibration sarnpile was required to finish one successful tria 
l^|]-^^gepe requir.ed to have two successes^ before Mving-on to 
^e\t hage. 'Thirty subjects took the Kaaws course, 80 completed 
Irst f^uc tio n was given at individual CAI terminals. 
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Subjects finished .the course, and learned to perfornl ?at1?,fac- 



final criterion behaviors. Practice effects were unexpectedly 
slight; people who Had one success at each stage of the course^had aDout 
thgWana c ri terion-problefTi p^erformance as thpse who had two successes 
t/TOughaut. The average tirne reqijired to acniewp a second success was 
fal appreciably different from that required for the first, and two 
iUcesses .^f the imnied la tely preceding level ivas no fetter than bne, a^^ 
fml c^i transfer to the next' higher st^qe was concerned , These results 
injdfcated that the Wollner hierarchical rtiDdel could.not iriprove ove^rall 
l^rning f^uch by '^optii'ial^ scheduling of practice. 



' I f i i'lp M ca t i u I) ^ ' 
/^her e the top ui 



d^perderit on 
pf^oc tice t rial 
a nd 

kf nd 

priC tlce t ri alb 



1^ ibti fmdifigs u that in rr^nnlex ler^rnlnq hi^^-^^r- 
jbt di f f 1 Lu] I td^l^ consi' 
pfeviously-learried ski ils, per for mantc^ tii-'^e . ^ --^^ - - ■ 

the number of subskills involved than Ofpo> the number of, 
rials i n [>rewedifig s tages . Another impl i cat 1an . 1 s that if 
practice and trdnsrer effects dre t^i De significant in iQarping 

of hi erdrchi cal ly-s tructi.red material, then-a very larqe nufnber of 
II j ay be neie Sbd ? y 




rr^npl ex 1 er^ rn i nq 
cif a col lectiun 'of 
pn th^t^^p task riay be rTiof^e 
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TR No. 77 



■Richard/D* Wo 11 me r 

aa*infinite pla 



Partial ly observable , Markov ^cfecision processc 
anning horizon witti di scou'rvting, ti^rch 1975. 



^ * . ^ ThIsMs' 
W f^tieMtlcal a 
^tructional 
la ted. to that 
wi th Marko^ de 
not known wi th 
' by a p bjh i 1 i 
* ^ forriis ^m^^%y%t 
wishes to dete 
to niax^mi ze th 
t*'^ 1 % prob 1en^ e 
the inf.inite ..t 
difnensional Ma 
as a f unC ti on 
developed for 
situations as 
val ue. 



the last in. a series of tecf%nicll re 
pproaches to instructional sequence^ 
systems.^ The prqblem treated- here 1 
treated by Smallvvood and Sondik (4). 
cision prDCesses where the true stat 
certainty. Hence the statf of the 
ty vector. ■ Each action yields an ex 
em to a new state and yields an obse 
rminfe an action for each probability 
e' total e)cp€ct€d reward. Small wood 
xactly for a finite tinie horizon. T 
ime-. horizon with a discount factorT"^ 
claurin series to approxifnat& the to 
of the probability state vector. Wh 
computer aide^d instruction, it is^ ao 
well. This fTiodel also is of conside 



pD^-1t&^ cpncerned v^ith" 
opt^fnl lation in 
s very closely re-' 
fioth pfpe^^s Jeal 
e/of systeTTi^ is 
|/ysteiTi is characterized 
Bee ted rev^^rd, trans-, 
rv/abl e outcor e . One 
Sjtate vector sp '..as 
a^d Sondik (4)Aolve 
(ns report tre^s 
usi ng a partial' % 
tST optiniaT fewBjd 
1 1e • th 1 s nodel wa s. 
pli cable to other 
rable theoretical 
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This line of research, which had begun before the inceptfon of 
contract hen reported, culminated in July, 1970, in a tec>inlca1 
Oft describing the resi^lts of an 'arduous lerieS of expe rf men ts . 
cia} purpose data collection instrunrtents 'were devised and builtj 
ctrical noise shielding was designed and impl eniented , and special ■ ^ 
twci^'e for data collection and a'na lysis was written and tested. 

'^The goal of the research was to re j ate electrD physiological 
noniena to ongoing cognitive activities. Subjects were required to 
ve f i ve-1 e^tte r an^^arns. Solution achievenent was signaTled by ^ 
ssing a nii croswi tch , El ectroencephalographic activity and time to 
ution wer% recordeJ from the onset of^each stimuKjs. Si.?<ty stiinulus , 
grams were selected f rorn lists of abstractness and usag,e freque.Bi^ 

four sti mul us groups; 1) concrete/high frequency, 2) concrete/ 
f reqWncy . 3) abs trdct/hi gh frequenp^^ and 4) abstract/low frequency. | 
lysis 0% the stjlutiun tiiMe data showed that abstractness and frequency 
1 had siynificcint etrfectb, vwi tft riu intdrdction. Analysis of the 
:troencepha 1 u Ji apli i u Jaid shuwed that dndgram solution and recogni^ 
f of non- ^cr arnbled wwid-:^ ^ere buUi fulluv^ed by a positive shift, which 
be related ta Jeci^^iun tjruucrises. 
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\ ^ . . TR No. S6 _y ' I 

Louis A;,H^ilHains & Joseph Rigney^-^^lectro physio logical correlates of 
cognitive' activitj^: Event -rel eted slow-potentials developed during 
so,i\jtion of anaarams, July 1978. 

' ^ ' , \ , ^ : 

' EUctroencephalographic (EEG) activity and time to solution mre 
recorded rfor si xteen human subjects' duri ng a task requiring the solu-. . 
t1on of five letter anagrams. • Sol ution' achievement. was &1gnaled by 
depressing a mi cros^^n' tc^. The sixty^ stimulus anagrams vmre selected 
from lists* of abstractness and usage frequencj^ to %rm fgur stfmulys 
groups: 1 concrete/hi gh frequency, .2) concrete/low frequency, ^ 
3) abstract/high frequency, 4) abstract/low ^frequency . StirnuTus. words 
we^e presented to subjects in a randomized order i nterspersed wi th a 
non-anagra^: recogni ti on^wrd fTANGa)^or a blank scni|en (BLANK) . Jt1^u-lu? 
prfsentation was under computer control and displayed upon a cqroutf.' CRi^ 
Solution time I'/as subjected to an^analysis of varl^ance.. Abstractne^s anc. 
freouency were both s igni f iWrrf; Abs tractness^ had the greater effect 
upon solution Um. There were no interaetion'effects. Concrete (low 
abstractness) afti^grams were solved more^quickly thaffi abstract ^ayrars. 
w^ith the effecty^f frequency of usage, addi tive to solution tim^V. This i 
result was con^Nuded to support, but not conf.irn>^a- para lie] processinq 
hypothesis: conscious processing concerned with anagram letter re- 
arrangement, and simultaneous unconscious processing concerned wi tK 
retrieval Of, pos^sible solution words froni long term memory. 

. ■ The EEG was analyzed Fourier methods to determine frequency 
and amplUude content. A coherence anaLysi.s was performed upon , 
selected segments o.f the EEG pre and post response. Visual analysis 
of individual trials was accbmpl i shed through a computer developed 
super-imposnion display. Di spl ayed ' tri al s were organized by correct 
or incorrect solutions, failure to achieve solution (TIME-OUT)'. TANGO 
or BLANK tj-resentations , "The development of a negative sh-i f t^Il ow i ng 
stimulus cinset in aH except BLANK trials was revealed. Trial^ri which 
a correct Solution was' achieved , or TANGO recognition occurred, showed 
a reactive shift to positivity at about 350 milliseconds latency. This 
Identificition was supported by the anal3'sis of coherence, The negative 
shift was concluded to be similar to the Contingent Negative Variation 
(CNV). The positive' shift was concluded to be a P30n wave. The CNV- 
like shift vjds related to selective attention-selective respnndii.ci 
demands of- the paradigm, Th|. P3no was related to decision processes 
allowing « relaxation of attention and responding. 



-12- 



' ^ 7^ V. COGNITIVE STRATEGIES FOR TEXT PROCESSING, 
{ Work Sf): area was carried out from January of 1 976 to the. 



end of the con>ntt. Four technical reports and four chapters in books 
describe ^the'^ults of the research. (The 1as^or/.^ese reports, Tech, 
Rep. Hp, 85, washco-spdnsored' by the Defense Advanc^^u -'^search Projects 
Agency under co/ilract- NOOOl 4^77^C-0328. ) These technical reports mark 
four stages in the inception of' a large effort to understand the nature 
of some of the higher cognitive processes ir\volved in reading and to 
apply the findings to the developriient of training programs foV job- 
related reading, 

' In the first ut the four repurts (Tech. Rep. Mo. 78 ^ an. ex tef)S4 ve 
s^urvey was inaJe of many recent trends in cogni t1 vej^cience and neuro- 
science whUh ^uulJ be ^ApeLted to have an impact on instructional theory 
^and practice. Or^e of thtr 'fiany cOfiLepts' i n troduced in this paper was that 
of the relevaf>ce u|f text.^ ty pe to reading in general and job-related 
reading in pdrucu|dr%. It was b^i^^t^^teJ that not dM texts are of the 
idm type^--the, iidVedifte^- i .1^ jnj b^-antit whdr-acterlstics 

vvhich LdH be tfAi^^cned tu f.avt. im,m n j i lurib fur what drid huw inuch of the 
informatiun the, c^^itdii^ M rt-'^MiLcred dUet rtoJiny. The second 
report in this berifeb (JeUs kul^ bU)^ expanded upon thu the^^e, 

presentifwj a theureliwdl viev^puihL un the rule of text- type percBptions 
1n reading. A numbl^f redUing strategies were discussed within ^the 
theoretical Lutitext br upuunJ^J In the third paper (Tech. Rep. No. 81), 
the theoretical undelp mn inyb ut lU^ preLediny paper were exaHned in 
greater detail. The theoretiCdl frdmework wdS extended to cognitive 
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tasks.other than reading, as well. In the fourth report of the series 
{l4ch Rep- No. 85), the theoretical mechanisms -devel oped in previous 
reports are applied t&^^ particular eKperimentpl sitLjatlon and predictions 
for the memorability of proposUions in different types of^texts are^made. 
"^WjKe results of a series of experiments " de&i gned to test these predictions 
are^Veported, the analysis of which supports the major aspects of the ■ 
■ theory. The experimehtaT results suggest that the theoretical approach 
may serve to generate, useful reading strategi^^ .sensitive to the type 
of. text beingW^e'^d, which can improve learning from texts of different 
types si gni fi cantiy", - ^ * " 



TR 78 1 ' 

Joseph ^Vi. Rigney, On- cognitive strategies fori faci li ta ti ng acquisition, 
retention, and retrieval training and education, May 1976, 

im idea that students coulti be taught to be more effective learners 
in distinction to being taught subject matter, is explored in relation to 
recent advances in the cognitive and neurosci ences , with the objective of 
integrating i nfornid t ion fron. t^nese sources into a unified viewDOint that 
could serve as a roadmap for research and as a context for discussion, 

AQC^urdiny Lu ih 1 b viev^pyirii, Lognltlve strategies for facilitating 
acquis i ti^on, reieniiun, and retrieval of information and of performance 
are composed of sped f l^ati ur,s , called orienting tasks, for how cognitive 
processes arc Lu be used, and or cognitive processes drdwn fron. repre- 
sentational selecLional, and sel f-di recti onal resources. Representa- 
tional resou^ L^es include pr opobi t ional and appositional processes of the 
left and right cerebral hemispheres, chiefly language and imagery. 
Sel ectional resources consist of attrintlonal and intentional processes, 
Sel f-d1rectional resources include self-programming and self-monitoring 
processes. Possibilities for teaching students better control over 
attentional and intentiondl processes, by usinj neurophys iol ogi cal 
indicators, particularly to reduce self-generated distractions during 
learni ng, ar e noted 
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Concepts of processTng capaci ty , 'depth of processing; expended Dro- 
cessing capacity,' resource- U mi ted and data-limUed processing, top . 
down-bottom up processing, and. graceful degradation of output., advanced' - : 
by several different theorists, ,^re considered in ternis of possible sources 
of Thdividual di f fe r'ences , po'ssible electrophysiological indicators,, and 
implications for cognitive strategies. The Importance of long term 
' memory in learning is recognized. Three types of long term store (LTS); . 
semantic, episodic and mo^tor, are described. Semantic and epispdic LTS 
are of great current theoretical interest. Their impl ications , 'particu- 
larly of semantic LTS, for acquisition, retention, and retrieval are . 
discussed, Norman' s concept of web-1 earni ng is an example.: The additTonal 
requirement for some lind of LTS for controlling skined performances is 
- noj^d, ana two recent theoretical formulations of cerebral -cerebellar 
roles in this regard are reviewed. 

^ ' K ■ \ 

^ Several kinds uf subject-matter are .descri bed under information and 
* performance and these are tentQtively^cross-cUss1fied with types of^ 
Icng te^^i. nemory and strategies for acquisition, retentfon, m6 retrievaU 
Different approaches to teaching students cognitive strategies are 
described in terms of nassible combinations of instructional control and 
explici tne^ss of the strategy. Finally, techniques ^ for 'implementation of 
aDnropriate apDroaches are^onsidered , The Learning Assistance Center 
(LAC) conceot is viewed as the content for applying 1 nipl ementation 
techniques in a ^vstenatic and long-term fashion; i rcluding diagnosis 
of individual student requi reriients and resources, prescription of an 
appropriate combinatiun of strategies, and instruction In how to use 
them/ It is proposed that LAC^s might eventually be recognized as impor- 
tant resources in Mav^l trdimng. 
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Cu I i £; I ' L I ^ ;ic . • . n . !. . C >3 I . ■ 1 ^ hai f fed Lflc 1 j . K u f © f rdHie 

wu.k ..ittiiM .ruh tu b,ud the effects of a reader's [irlo- kfiOwledge 
on fii b o» her Or an unfamiliar text. As a result, most 

readiny ^c?beaich fidS c'l.pi-d:, i zeJ perceptual rdther than concentudl 
processing during re-idiny. Evidence is cited in buupor t of the clai 
that various type^ of prior knowledge play important roles in under-- 
standincj during te^t prucesbing. 

Recera Je^eiuMM^nt^ in LugriUiyc pbycfiulogy and drLlflcial 
intelligence have re^^ulteJ in a new kind of model for conceptual pro- 
cessing, called procedur-a] sei^ntiCb. In this report, a framework 1^ 
laid=for the application Of the procedural semantics formalism to the 
analysis of conceptudl W drUen processing in reading. According to 
this theory, two dlfferen't typeb of conceptual processing units ^ 
(cialled sche^mata ) •are responsibl e /or conceptually-driven processnng 
inl readinaV^ One type is the form-Khema, which accounts for the 




syhtactic br: formal expectations which peapUmake use of in text 
processing J The other type is the .content^scherm , which accounts fg/ 
the nature readers' semantic expectations. Models for a small numbif 
of specific ;form- and content^schemata $re proposed, and certa^ exoen^^, 
. mental \and ebservatiOQal evidence is expUlned in terms of these rtiddels.^ 

Implications for effective reading strstegies for adult reading ©ra 
^derived from the pr&mises of the modeK Several different kinds 'Of 
reading strategies are characterized in terms of the TOdel , When 
readers empl-py si ngle-pass strategies, thay process the text ma 
strictly linear, left»to-right fashion. Thi.s approach makes miniral 
use of the potentiaUfor conceptually-^dfi van 'processing that. could be 
achievid through the activation of son^ high-level schemata. In 
exhaustive multi-pass processing, the first pass results in the activa- 
tion of a number of form- and content-schOTata which can seTve as an 
aid in subsequent passes, deriving expectations about the form and 
meaninQ of what is about to be read. ThU techniqiie can o-ften be 
wasteful of resources, since^it does not actively direct processing 
toward what is most important or least well understood. Extra ctivg 
mult i-pass processing reflects a more efficient strategy for reeding _ 
an""entTr^' text. ^ By using this techniqueV a reader ■'skims'' the texf^ in 
a selective v^ay orrrepeated passes, building up 'such a complete under-^ 
standing of the meaning of the text that the final reading of the text 
is often a process fff merely filling in the gaps in understanding. ^ 
This technique is often effect! velv used by graduates of adult reading 
improvement classes. Selective, multi-pass strategies characterize the 
reading of those who know what it is thfy ^ant to know, and^ who are 
under no constraint to learn all that might be learned from a text. 
IrVthis type of text processing, the reader begins the Usk wi th the 
intention of acquining some speci f i c J n^formati on , As a result, & 
fl)mber of speci f i c con tent^schema ta Sre activated and are used to. guide 
\he order and the selection of those portions of the text to be pro- 
cessed. 

SevbTdl potential dPHM^otions are sugcjested by the consequences 
of the theory for conceptL^l ly-dr1 ven processing in reading presented 
here. These include possiDle uses for hiadii^-^J^n texts, means for 
constructing advance organizeiS fo) texts, arid training readers to 
.make f^e effective wse of textb by being sensitive to their moiivaiiriH 
'tasks and by exploiiiny their capacities for generating expectations 
about the meaning of th., text^ through conceptual ly-driven Drocessinu 
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Allen Mum „ h iui.L^A, w Kiynt, , A ^uhtttnd irieu-) dCLOunt of SOiiie (.uyiiHive 
procebSts 1n c>>inpifc>. learniMy, ju1> IS??, 

Procedural semantics rodels have diminished the distinction beiween 
data structures and procedures in computer simulations of human intel- 
ligence. This development has theoret,ic<3 1 consequences for models ot 



cognition. One type of procedural semantics -TOdel , cdlied schema theory, 
is presented, and" a variety of cognitive processes are eKplained in 
terms of the theory. In iChema theory, the flow of processing control 
i-S determined not by a central ftionitor, but. by interactions amwg the 
conceptual entities (scNMta) that make up the model. Schemata interact 
by providing activation resQurces to each other. 

Instantiation 1s the special' process whereby a partial copy of a 
strongly activated schemes created. In this copy, the variables of 
the schema are filled with particular values. Such copies make up 
specific or episodic memory, The schemata on which they are based 
comprise generic or semantic memory. 

Many of the phenomena of 'consciousness and of short-term and^ long- 
term memory are explained on the basis of the activation processes of 
schema theory. Unactivated scherriata are equivalent to all the unconscious 
knowledge in a person's U;^^-term memory. Schemata that are \acti vated , 
but are'below the thresholcl of Instantiation, are in a Dreconscious 
or subconscious state. Those scheniata that are more fully activated, 
that are above the i ns tanti ati on- threshol d , are the stuff of conscious^ 
thought, and may be thought of as roughly equivalent to the contents of 
short- term memory. ^ 

Conscious coynitive strategies are treated as the activations of 
abstract prescriptive scharn^ta. A treatment of creativity is presented, 
along with the'outlines of an approach to individual differences ln 
creativity. The effectb of orienting tasks are explained in schema 
theory, and the relationship between orienting tasks and bel f-d1 recti on 
in complex iedming^ and problem solving is discussed. 

InrereriLe dnd depth Mrocts^.&i ng receive related schema theory 
treatments. Both concepts dri treated in terms of the extent to which 
activation spreads to incljd^ related schemata. In general, the more 
schemata activated to 'he lav^l of Instantiation by some datum, the^ 
v^c^e i^eply processed th^i Mtum U. Inference is seen a kind of 
dulayed ioepe^ ' proces ^ i ng , 

Types ot iri^i jhi pticN. ^fid f ' uiii sever d) uumlcaU w-an dlso be 

L-rdUd in bchyd.d theo.y Each L/pe uf insigf>t invDlv^:.s the inbtantiu 
tion of one or mo.e new %.he'mi^ thad take some pre-existing concept 
in memory ab a pdfd,..eter j 

Three d1 MienS 1 ufi^i fw^ J t S u n^^iu^h i ng ui conr,)cir i n j bChenidtd dff 
proposed; function, abb tr^^s^tness ,j^nd scope. The contrasts between 
multi -store niodels uf co^,ifiitiQn dW SLhema tnt^ory are summarized. 
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Lyrm Gordon, Alien Munro, Joseph W. Rigney, Sr Ka'thy A, Lut2, 

Sumrnariei and rticalls''for three types of texts. May 1978. 

A theore'tical brientatjon for- the study of different types of 
texts Is presented. Schertia theory is propose* as a useful mfita-theory 
within which to devel op -speci f 1 c theories about reading. Both theories. ■ 
about processes of reading and theories about the structure of what is 
read can be. readily formulated in schema t^^eory terms It is proposed 
that readers make judgments about the types of texts that they read and 
that these judgments bring a'bout the activation of expectations wUh 
respect to the structure and meaning of these texts. 

previous work on the structure ,of texts, primarily for simple 
narrative', i-- reviewed. Problems with' earlier fo^'nalisms and sconng 
methods art discussed; and heuristics for avoiding these probl er^s ^''t^^ - 
presented , ' ■ ^ 

Three types of texts were selected f^r study. . One type was Vm 
simple short -story, a type closely related to (and, in some cases . 
identical with} the kinds of texts studied by other researchers. The 
s'cond type- studied were instructions. The third type was definitional ■ 
explamrtions, a type well characterized by fP^^f "scienf article. 
Detailed analyses of the text structures and text semantics for eight 
texts tthrea stories, two instructions, #nd fhree .def^ig^ ti oqs ) are 
presented Texts of the different types aiffir f rom ^^Wtrh o%her in 
consistent ways on two dimensions. First, the text structures of 
definitions tend to be organized hori zontal 1 y '-rather than vertica y, 
as are the text structures of Stories and instructions. Second, tht 
semantic representations of Stories are composed ^f^specific concepts, 
in schema theory terms, while the semantic representations of ^^st.uc^ 
tions and definitions consist primarily of generic concepts On the 
basis of these differences amoTig the texts, we predicted that tones 
would be better remembered than instructions, which would, in turn, 
be bette. remenbered than definUions, Three experiments were con- 
ducted to test this riyputfiesis . 

In Uf^^^|^melil I SubJeLLfe leoJ and b umind r1 zed Six texts and 
> later recaHed threu of these t«xts, Andlysis of the summary data 
Indicates tiuit texts of Siifferent types are summarized to about the 
same 6»xtent. Ihe re.all ^data, however, suggests that text tyoe may 
determine m amount recalled. Analysis of the recSll data showed that, 
although stones were remembered best (as had been predicted), the 
propositional content of definitions was remembered better than that ot 
instructions It was hypothesized that rereading and summanzinq may 
have had .i di i tercnti dll v facilitative effect for later recall, bene- 
fi 110*9 the recall of definitions more than instructions. 



In order to test this hypothesis. Experiments 2 and 3 were 
performed, Sgajects heard tape recorded texts (in Experiment 2 the 
same set of ta^ts used in Experi rnetit 1; in Experiment 3 a somewhat 
different set), and, after performing a brief interfering task, 
recalled each text after hear.ing it. They were therefore not able to 
reprocess te.xts as they had been able to in Experiment 1 . In qeneral,- 
the results of these experiments confirmed our predictions; . stories 
were recalled better than instructions, which, in turn, were recalled 
■better than definitions. Subjects' recalls in these experiments were \ 
also scored for the amount of reordering of the textual material. 
This analysis showed a very powerful effect due to text type. Recalls 
of definitions showed significantly more reordering than did recalls 
Of instructions, which, in turn, had more reordering than did the 
recalls of stories. These results are also in accord with our theory 
that stories have more hierarchical, differentiated text structures 
than do instructions or definitions, and that definitions have less 
hierarchical structures than do Instructions. 

Subjects in these two experiments were also requested to cluster 
t'le texts in natufdl groups accordinq to their types, as they be r- 
"^ceived thenu Their groupings were remarkably consistent with o^r own 
classifications. ( , V 

I 

The re^tfarch presented de^-^ns trates the need for a rnore thorough 
investigation both of the nature o|f people's expectations for differences 
In different t/pes of text,' and ofl the effects of such expectations 
on understanmng and n^e'^iory. Furtjhe^ir&earGh-^ s also needed to explore 
the hypothesis tna^^te^ts of dif ferenf^types my benefit differentially 
from the appl 1 ud 1 1 rfff^^ poriiLuldrl learning strategies, such as re- 
reading and su^^arH^ing. 
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' ■ ' VI. HEURISTIC TECHNIQUES FOR LOGICAL . ' 

. , PROBLEM SOLUTION , ■ ■ 

This research effort was pursued from February of 1977, to Juno 
1978. Ongoing BTL interest in the nature of cognitive processing 
ddrvivng troubleshobting activities motivated a series of studies on 
hofvpeopTe solve verbal logic problems. Two technical reports were 
produced. The first report describes an initial evaluation of two 
computer programs designed to aid human problem solvers. EKpferience. 
with these programs 'and with the Introspective, reports of logic problem 
sol vers led to the posing of two basic questionsj first, what factors 
in these problems are predictive of their difficulty, and, second, 
what strategies can be- taught to Improve prob]em solving performance? 
'^Ifhe experiments reported In the second technical report (No. 87) 
provided partial answers to these questions. It appears that one of 
the most important predictors of success in the solution of these • ; 
problems was the subject's .ability to convert the verbal representation 
to some';mo,re logical ly'majiipulable representation. Those problems , 
which were couched in such a way that such a translation was. made more 
difficuit were harder to solve. A training system for' improving logic 
problem .solution was devised and tested. ./ Experimental results show 
that use of the techniques did improve performance. Future efforts in 
this domain should concentrate on transporting the training system 
attributes to a real-world domain, sucK as electronics equipment troubl 
shooting. * ■ ■ : 



,,, - TR No. 83 ■ „ , / ■ ' 

■ Nicholas A. Bond. Jr., wmiam**T. Gabri ell i , &'' Joseph W. Rigney, 

Studies of verbal problem-solving; ■ I. Two performance-aldvng . 
. . /'programs, August 1977. , "'^-^ 

Two computer programs'. were written to 'provide on-1 ine aiding to 
human probVem solvers. Both programs -were written In time-shared BASIC, 
and were designed for "membarship" problems . r In this kind of problem,, 
there are several English sentences and implicit in the sentence^ are, 
various relations; the task 'is .tp infer a membership structure that is 
compatible with all the, logical' constraints. Membership problems may 
be cast in various settings, such as- a murder mystery where , a culprit is 
to be identified; . ' . . ' " 

One program (FIRSf) was based: on Ftndler's "Universal Puzzle . 
■Solver" concept; the other (GABE) used Wang's theorem-prover logic. 
In both programs,' the human operator convertpd English, problem sentences 
tO' logical memBership relations.. , The programs kept track of all rela- 
tions entered, indicated when more data •inputs werl needed, and scored 
whether a correct answer vyas achieved. 

0"f the two programs s FIRST appears^,to be most feasible with 
ordinary college subjects. It accepts logical inputs 1n a near-English 
'format, and shows current logical status of a problem tabular arrays 
of X's and O's. The present version of GABE used a strict "p, q,,r" 
logical notation; collage subjects find this difficult, and unsatis- 
factory , , 

The structure of the FIRST program suggests a "depth-Qf-lnference" 
measurement technique, When all possible logical paths in a membership 
problem are known, the "depth" of any given node in the path can be 
obtained f rpm probabn i ty-of-success numbers at that node; also it 
appears that^a subject ' s . logi calprogress along a path can be comouted 
and displayed. Further empiricaT work will explore the usefulness of 
such depth measures for scoring individual performances, and for 
teaching problem-solving heuristics in technical materials- 



^ TR No. 87 ' ■ 

Nicholas A. Band. Donal McGregor >^Kathy Schmidt, .Mary Lrtt1 more, &^ 
Joseph' W. 'Rigney, Studies of verbal Rroblem-solving : II, Predic 
t1on of performance f rom sentence-processing,.scores , June 1978, 

In complex reasoning problems of "trte who-done-it" type, four . 
distinct solution processes were identified: 



(1) 



(2) 



(3) 



Intra-sentence or word-i.ntp-sj'mbol processing, where the 
sol^ver, converts' the' verbal information into 'strict logical 
relations; 



int er-sentence processing, where the subject has ,to combine 
IHi" logic frOfTi two or more sentences in order to obtain new 
Terences ^ 



ordering of problem variables into some rank or numerical 
orderi ng scheme i 

collecting the logical relations into a reliable format 
that win reduce' the memory Toad •and.faciTitate the . ■ 
"whpre-to-look-next" decision, , . 



This stud> explorfd the extent to which separate scores on these processf.s 
could predict performance on difficult problems. . , 

■ ', ... ' ' ^ . ... 

Scores on the sentence-logic items correlated well (r='.6B, W-i^) 
> with number of reasoning problems solved, as did the ordering_ score^ 
{r=.75). These scores, then, presumably are "closer" to the actual, 
performance than are verbal, scores such as McGraw-HI 11 Reading Rates ' : 
{r-;40 to .50). Individual timing of i.nference responses showed that 
subjects often had Tong pauses- during inter-sentence processing,, whereas 
■intra-sentence responding w|s relatively fast and regular,. The inter- 
sentehce portions of the performance appeared to be key discriminators 
between success and failure. . — ;' 

. A small training .experiment was. carried out with seven new subjects , 
who were matched on reading scores with the previous group. These si' 
jects were given six hours of intensive, Individual practice on the 
■processes; a standard matrix format was used, and five rules and heuristic 
were taught whi ch were . supposed to facilita'te Ihter-sentence reasoning. 
The trained people did. show Improved sentence-logic scores (median about 
40^.'. over the comparison group); and If a large reasoning problem contained 
only straightforward sentences, then the training was very effect! ve. 
In fact,, all seven' subjects solved correctly a 4-dimension, 5.-variable ^ 
negative-disjunction problem within a few minutes. For those problems _ ■ 
which hinged upon appreciation of verbaT subtleties,, though, the training 
did not hel p at al 1 . 

The investigation supports the idea of rapidly teaching some _ ^ ■ 
"logical tricks" in higher-order cognitive operations; but the special 
training only works if .the problem material is clea'n.and unambiguous. 
One obvious extension of the study Is to ^ee if the same Increase in 
Pfrformance can be produced in a' practical-reasoning domain such as 
troubleshooting of digital devices; another extension 1s to look more 
closely at the verbal subtleties which so effectively prevent solution 
of some large problem. 



; 'VH. ; MAI'NTEN^CE TR/^NER-^ . . ' 

Work in this area proceded throughtfut the term of^ the contraot, r ' 
building upon previous research on cornputer-controned trainer simulators 

' done at BTL untier ONR/ARPA funding. Two technical reports were produced. 
These repoiits describe a. revi sed trainer-Simula^^ calTfed the Generalized 
^Maintenance Trainer-Simulator (GMTS), and report on two field evaluations 
of the system. The present 'contract supported the development of the 
GMTS system and programming. Development of dat^ bajes and the conduct 
of the field tests were jointly sponsored by ONR and by the Naval 

^ Personnel Research and Development Center. / / :/ ^ ' 

: The phnospphy of the GMTS system is that there should be a rela- 

tively low-cost^ stand-alone system for in'tfenslve practice in trouble- 
shooting. Furthermore, the hardware dnd software should be general- 

. purpose. That^ IS V it^-should be possible to enter a data .base, for a new' 
piece of equipment and provide students with pract1-ce on the ne^equlp- ; 
ment without making changes to the hardware del i very system or the' 
:GMTS programs. The two technical reports produced, taken together, 
constitute e.vidence that, GMTS has this general nature. The system was 
used first to provide practice in systems level- troubleshooting In the 

^ UHF communications side of theTleet Communications System. The^system 
was .tested with this data base on twenty students about- to enter'cTass^ C 
schools,' The second evaluation of the system was performed with the 
AN/SPA-66 Radar Repeater; ten subjects used t^ls system for trouble- 
shooting practice, then worked actual troubleshooting^ problems inserted 
vinto in AN/SPA-66 equipment. In both .cases the same hardv/are and GMTS 
* program, was u^ed, Aut with di.fferent data bases. 

o 
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Developmenf work 1s now proceding, under the 5f)dfn|orsHip of NPRDC 
and ARPA, to convert the GMTS system to current generation .hardware,. 
to develop a new data base, and to implement and t^est the new syitem 
in a Classic school environment, ^ 



TR No. 89 ^ ^ * 

doseph W. RigneyV Douglas Towne^ Carole A.^K1ng,,& Patrick J. Moran, 
' Field evaluation of. the generalized maintenance trainer-simulator: 
^ " X. Fleet communications system* August 1978. ; . 

The General i-zed' Maintenance trainer-Simulator (GMTS) is a concept- 
for giving students in Class' C schools Intensive practice in trouble- 
shooting equipment and' systems taught in those schools. It can.be used 
for. any device in which signal paths ^nd their relationships to controls, 
indicators, and test points can be defined. The GMTS uses generative 
CAI .That is, it generates the interaction with the student by re-, 
-ferring to his Vast inputs and to its stored history of interactions 
with him up tc| thaV point. To the extent that these individual student , 
histories cons'titute models of IndividuaT students, GMTS constructs a 
model of each student to interact with that 'student. In- addition to 
these features, GMTS is- uniquely suitable for. use in. Class C .school. 
training. The computer program that implements the instructional,- 
system is indifferent to the specific equipment being taught. What \. 
specific equipment that is simulated by the GMTS iS'determined by_ ^ 
loading two data bases for thatequipment: one describing essential 
internal features of the equipment a'nd the other describing ' the external' 
features. • . - / 

. - ■ . ■ ■ ,. . ■ . ■ . / . ■ ^ - ' 

This is a report of a field evaluation of the GMTS apDlied to 
systems level troubleshooting in the UHF communications side of the 
Fleet Communications .System. Twenty Class school Students waiting 
to enter C schools practiced sdlving thirty- five troubleshooting problems 
Results were generally positive. The students became- uniformly more 
fluent at troubleshooting; mean times to solve a problem were decreased 
by a factor of two, and standard deviations of these times were decreased 
by a factor of five. Also, students' attitudes toward tb| trainer were 
generally favorable. An additiortal field trial is underway, using the ' 
Afi/SPA-66 radar repeater as the subject matter. 



. ' . TR No. 90 ' , ■ . \ 

Joseph W. Rigney, Douglas M, ^Towne, Patrick J. Moran, & Richard A. 
Mishler, Field evaluation of the genefallzed maintenance 
trainer-simulator: II. AN/S'PA-66 radar repeater, Noveniber, 1978. ■ 

'This is a report of a field evaluation of the General i zed Maintenace 
Trainer-Simulator IGMTS) applied to troubTeshooting the _AN/SPAr66 Radar- 
Repefiter. , ■ - 

The GMTS is a relatively low cost, stand-alone system for providing , 
intensive practice in troubleshooting. While GMTS is both hardware and 
computer software, the computer programs and associated data base represent 
the essence of the GMTS concept. This concept can be appl led' to any 
equipnient or system by compi ling the particular effects of indicators 
1n various configurations and modeSi and by preparing. microfiche images 
of the equipment in a mul ti tude ,of normal and abnormal states.. This 
information, contained in a data base dedicated to the equipment to be 
simulated, provides the GMTS'program everything necessary to generate , : , 
and present meaningful i nteractions with each individual student. Since,- 
the program itself dois not contai n data speci fic to any simulated 
system, the trainer-simulator is termed 'generalized.' 

; This field test was the racond to be c'ondutted; the first Involved 
twenty Class A school students troubleshooting the UHF communications, 
side of the Fleet Communications System, . A major objective of the ' 
second' field test was. to demonstrate the generality of the trainer- 
simulator, thus a com^tetely, different equipment, was-implemented. The 
data base for this target equlpment^was constructed entirely by two 
technicians who received brief trafning In GMTS data base formulation 
(whereas the. data base for 'the first field test was assembled primarily 
by the personnel responsible for programming GMTS). . . 

The field test involved ten subjects, each attempting to isolate 
thirty- three simulated malfunctions over a sixteeri-hour period Followi ng 
this practice phase the students were tested using an actual AN/SPA-65 
with actual. Inserted, malfunctions. ... 

As with the first field test, results are generalTy positive, 
especially, in relation to success in the test phase using actual equip- 
ment. . Owing to the small sample size, however, this field test is more 
valuable in assessing the success with which. GMTS can implement a wide- ■ 
range, of target systems. ., • , ' , 



'/ .. . viii. 'recommendations ' .; y ■ , 

All of Me areas of research pursued under this contract have . 
the :poten.tial' for •producing products useful to the Navy. Specific , 
recommendations can be made with respect to five 6f these research 
areas, the products 'of which di ffer in their current; app 
One of the research efforts, the development of the maintenance trainer- 
simulator, has ytefded a product which Is essentjally ready fof imple- 
mentation /^ysmty of Navy, school environments.. The discussions ^| 
the five T^search areas for which 'recommeri^a'f'ons can be made are 
arranged roughly in order of the immediate applicabnity, of their 
results, with the most immediately aRpllcable research 'products dis-, 
cussed last/ 

Instructional Sequence flptimization , 

The research discussed in Section III, above, resulted in a' 
system^ for optimizing an instructional sequence with respect to time 
in a CAI context. While this method did not presume that time was the 
only crucial resource for optimization, the work demonstrated the. 
difficulty of eKperlmentally exerc'lzing an Dptimization technique, in 
which^y a sub=set of acknowledged key variables are involved. Other 
factors whichshould be Included in the objective function include the 
^cost of an instructional sequence, the clarity of targeted concepts irh 
the instruct1o|ial domain, and performance measures of che student's 
grasp of the instructional content. 



,It is to be expectad- that the , armed services, as large organizat 
i'ions responsible for vasti amounts of technical /Instruction, will make, 
increasing use" of CAI systlms in the future. Features of CAI which will 



•motivate such grea.tfef'Huti 1 



zation will include low?cost, standardized 
instruction, and the opportunity for time-saving but still inexpensive , 
individualized i nstruction.l As the extent of CAI grows in the armed 
services it will become ever more important to be able to manage instruc 
tion in automatic and cost-iffecti ve ways. One aspect of such effective 
management will be lristru'cti|ona,l sequence optimization. Although the 
results of the research carried out to date do not Justify an Immediate 
devel Qpment ^ program^ to produif 



using Instructional sequence 



e a computer-managed instructional system 



optimization techniques for the Navy, the 
^potential benefits to be deVi|/ed from eventuany implementing such a 
system are gre^at. Support ofl further research in the area, particQlarly 
research emphasiztng several features of the Instructional sequence to 
be optimized, is indicated,' I 

Heuristic_Tech niqu gs for Prg:blem Solvi-ng , 

BTL research-In this dopin, described in Section IV above, has 
shown that logical problems couched in verbal form may present plcuinar 
obstacles for solution because of that form. This is an issue of con- 
cern for the military, because many technical problems and prepared 
information sources for solving technical problems are presented 1n' 
a verbal format. A technician who must operate or troubleshoot an 
electronic device, for example, Is likely to talk and think about his 
actions in qualitative verbal terms. His) attempts to validate his 



Interpretations of the results of his tests of the equipment may, be 
confirmed, guided, contradixted, or frustrated by the information in 
a verbal format in .technical manuals. Our results indicate that with 
a "clean" problem (that Is, one that Is well defined^nd expressed 1n • 
Simple declaratfve sentences) almoit any regular aiding format will 
assure rapid and accurate solutioh. This result leads to the practical 
possibility of reqUlrincL technical materials to be' written In such a 
way ■ that the text is j'clean,"' 

In the complex verba.] puzzle problem domain, a key skill is the 
identification of phrases which essentially split the problem into , 
smaller and more .manageabl e parts. For Instance,. 'If the problem has 
six variables which have to be sorted or Identified in some way, there 
are often one or two key se^ntences which permit simple categdrizatlon 
of these'variables into subclasses. .The skills required to identify and 
to exploit these Kigh-lnformation sentences have not been studied, but 
there is reason/to expect that such skills are highly developed in the 
truly expert problem solver, • perhaps the skill Is analogous to that , 
Shown by the ' troubleshooter wha makes a few rapid narrowlng-down checks 
to attain crude Isolation of a malfunction. Once Identified and under- 
stood, such skills should be explicitTy taught tO'Students such as 
eiec'tronics equipment technicians, who must learn to be effective. 

problem sol vers . \ 

A second major aspect ofUhe research findings in this area has 
to do with the use of automatj/ Droblem-sbl ving aids.. Complex intel- 
lectual tasks, such as combining probabifity information, controlling 
several aircraft, or troubleshooting eVectronlc equipment could be made 



easier for. those assigned these tasks through the use of appropriate . 
computer-based aid systems. Such systems would perform many library, 
calculating, and bookkeeping chores; the' controlling humans would, 
of course, make the decisions and control the course of procasslng. 
Our research in this area can be thought of as ,i first step tiward ' 
providing automatic systems' to aid rm logical pl^oblem solutioji. What ■ 
is required, now is an effort to develop such aiding devices fjor prac- 
•ti car mi'li'tary tasks and to teSt their effect! veness.'^ \ 



Visual Analog'ies, • - • , . ■ 

The research reported in Section II yielded results which suggest 
applications to the development pf CAI technical subject matter course- 
ware:. CAI perrTii:ts^ the use of Interacti ve graphics displays to help 
convey the nature of comple)^ processes to students. The results of 
our>esearch indicate that the use of such displays 1s most effective 
for* initial presentation of the concepts. Interactive graphics is - 
less useful as a review device for-student use. ^pe research, has shown 
that a more effective post-presentation learning activity is guided 
student reconstruction of a graphic display. This can be accomplished 
through the use Of a touch panel or a'spnic pen device, either of Which 
takes advantage of the students' natgral pointing responses. Further, 
research is now needed to determine what kinds of complex topics 
benefit most from interacti ve ■ graphi cs presentation' and from student 
reconstruction of graphics. Such findings cou.ld then be applied to.th/ 
teaching, of Navy technical subject matter. 

The low costs and other attractive features of CAI are likely to 
ensure Increased use of this instructional technique and medium in the 
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armed serviced. These features, however, will not necessarily ensure 
• that the most effective use of the capabnities of the.1nstruct1ona1 

computer system "win be used. .It is possible 'that, in some cases, 
attempts will be made to sim^y transport a tradltionaV training manual 
approach to the new CAI. courses. Such' a course would fail to make use 
of such features as interactive graphics. Our results have shown that 
this feature can improve learning over a more traditional approach. 
Further research could be expected to lead to the production of guide- 
lines for the effective use of. interactive grapHics' and guided student 
constructed graphics. Implementation of such guidelines would then lead 
to more effective CAI courseware. 

Cognitive Strategies for Text Processing ' - 

' Toward the end of the course of research reported In Section V 
an unanticipated result was discovered t^at may have important applica- 
tions' to the use of texts }or instructional purposes. The results of - 

i " ■ ' ■ • . 

three experiments Indicated' that understanding of and memory fy 'the 

contents of different' types of text!' benefit differentially frohi par^ 
ticular text-processing techniques. rFor example, memory for te^ts 
that have an explanatory nature benefits from tHte processes of re- 
reading and summarizing texts. Memory for instructional texts is not 
significantly improved through such techniques,. These findings must be 
thought of as tentative, but if 'they can be replicated in experiments 
of the appropriate designi their imp! ications' wi 11 have .obvious applica- 
tions for military InstriJCtion. Either of two methods could be expected 
•to prove the more effect4ve means of using the results to improve learn- 
ing from instructional texts. Texts could be prepared which incorporate 



directions to the^udent as to which technlquis should be applied to 
each segment ofjext.ln order to maximlEe learning from that segment.. 
Alternatively* students could be trained, in a short course, to recog- 
nize texts of each major type and to apply the apprbpriate techniques. , 
Further research is required before either of these methods could be 
developed for application in Navy schools. First, more must be learned : 
about the relationships between text type, and effecti've te^<t processing 
techniques. Second, expe,ri"insnts must be performed to learn whetber the ' 
improvement tn learning from Navy texts brought about through the use 
of these techniques .is sufficiently great to justify the development 
of an application. Third; It must be determined how these findings 
may best beapplied. The application of^the findings of such a research 
' program can-be expected to miasurably improve the^ efficiency with which' 
military students learn- from technical documents. 

The Generalized Ma1ntenanc& Tra iner-Simulator - ^ - 

The gei^ralized maintenance trainer-simula^r (GMTS) is the end- 
product of many years of research funded by the .Office of Naval Research, 
■and the Defense Advanced Research Projects Agency. The research con- 
ducted on this contract has shown that GMTS is an effective way of in- ^ 
creasing the amount of troubleshooting practice on particular equipments 
for Navy electronics sjtudents. It also provides the capability of , 
simulating a wider range of trodbleshooting experiences that can be , 
provided practically on real equipment. The research has shown tKat 
data bases for new types of electronic 'equipment can be prepared for 
the GMTS system by subject-matter experts who are not computer programmers 
Two field evaluations in Navy schools have shown that use of GMTS results 

-31- 'J'" , ' , 

. %j , . • 

' ■ ■■ ■ ^ ■■ ■ ' ' '■ .. ^ 

O 

ERIC 



In more efficient use of students's .time and in tHme savings fot^ Nav^ 
instructors, while providing students ,wi th extensive'V^ctice at low' ■ /: 

cost. • ; ' ■ : • ■; " . ' ;■• ■ ' / '.' 

The GMTS" system is essentially ready for general use in Navy 
Class C schools. Unfortunatny , however, in its current implementation 
it makes use of outmoded and unreliable computer equipment. Behavioral 
Technology Laboratories began research on a new contract, jointly 
funded by the NavaT Personnel Research and Development CenteT'and the ' 
Defense Advanced Research, Projects Agency, on September 30, 197S 
(N00123-78-C-1457) to (1 ) develop the GMTS software on current-generation 
hardware (Terak B510/A microcomputer) , (2) prepare new data bases for 
the new GMTS system, and' (3) to implement and test the effectiveness of 
the new system in a Class C school. The dev'elopment of the new software 
will have special cohsequences^ for the future and ongoing usefulness of 
the 'GMTS system to the Navy, The new software will be transportable 
to other computers; therefore, the GMfs system will be protected -against 
hardware ob'solescence. This will be accomplished by developing the new 
GMTS software on the UCSD Pascal operating sys-tem, a virtual ly machine- 
independent operating system for micro- and mini-computers. 

We recommend that, once the initial development phase of the new 
GMTS system is complete (approximately October 1979), data base develop- 
'ment for a variety of Navy Electronic equipments be developed for wide- 
spread use in Class C schools. We farther recommend that research on ■ , 
the' potential usefullness of the GMTS system in CTas.s A schools be " 
conducted. The GMTS system can _be expected to serve as an ;important 
component of all Navy electronics equipment maintenance "training. 
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